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Abstract —Flash memory is a write-once medium in which re¬ 
programming cells requires first erasing the block that contains 
them. The lifetime of the Hash is a function of the number of 
block erasures and can be as small as several thousands. To re¬ 
duce the number of block erasures, pages, which are the smallest 
write unit, are rewritten out-of-place in the memory. A Write-once 
memory (WOM) code is a coding scheme which enables to write 
multiple times to the block before an erasure. However, these 
codes come with significant rate loss. For example, the rate for 
writing twice (with the same rate) is at most 0.77. 

In this paper, we study WOM codes and their tradeoff be¬ 
tween rate loss and reduction in the number of block erasures, 
when pages are written uniformly at random. First, we intro¬ 
duce a new measure, called erasure factor, that reflects both the 
number of block erasures and the amount of data that can be 
written on each block. A key point in our analysis is that this 
tradeoff depends upon the specific implementation of WOM codes 
in the memory. We consider two systems that use WOM codes; 
a conventional scheme that was commonly used, and a new re¬ 
cent design that preserves the overall storage capacity. While the 
first system can Improve the erasure factor only when the storage 
rate is at most 0.6442, we show that the second scheme always 
improves this figure of merit. 

I. Introduction 

Flash memories are, by far, the most important type of non¬ 
volatile memory (NVM) in use today. Flash devices are em¬ 
ployed widely in mobile, embedded, and mass-storage appli¬ 
cations, and the growth in this sector continues at a stagger¬ 
ing pace. The most conspicuous property of flash-storage tech¬ 
nology is its inherent asymmetry between cell programming 
and cell erasing. While it is fast and simple to increase a cell 
level, reducing its level requires a long and cumbersome oper¬ 
ation of first erasing the entire block that contains it and only 
then programming the cell. Such block erasures are not only 
time-consuming, but also degrade the lifetime of the memory, 
which can typically tolerate 10^ — 10^ block erasures. There¬ 
fore, finding algorithms for increasing its lifetime despite this 
asymmetric programming behavior has become an important 
challenge. 

A flash memory chip is built from floating-gate cells. A 
group of cells constitute a page, which is the smallest write 
unit, and the pages are organized in blocks, which are the 
smallest erase unit. Since pages can be updated only if their 
accommodating block is first erased, write update requests 
are performed out-of-place. Thus, when a page is updated, 
its previous location is marked as invalid. In order to accom¬ 
modate this write procedure, the amount of physical storage 
has to be larger than the available logical storage. The ratio 
between the size of additional storage and logical storage is 
called over-provisioning. Furthermore, whenever there are no 
available blocks to accommodate page write requests, garbage 
collection (GC) is invoked to clean, i.e. erase, blocks for ad¬ 
ditional page writes. However, when a block is chosen to be 
cleaned by GC, its valid pages must be read and rewritten to 
a clean block, thereby increasing the total number of pages 


written to the memory. The write amplification is the ratio be¬ 
tween the number of physical page writes and the number of 
logical page writes. 

Reducing the write amplification is crucial as it directly af¬ 
fects the memory performance and its lifetime. In general, there 
is a direct relation between over-provisioning and write am¬ 
plification. Increasing over-provisioning reduces the write am¬ 
plification Q. However, high over-provisioning means that a 
large area of the memory is not exploited to store information. 
Thus, understanding the connection between the two measures 
is very important for optimizing the design of flash memories. 

Write-once memory (WOM) codes were first introduced in 
1982 by Rivest and Shamir p4| . In the binary version, write- 
once memory cells can only be irreversibly programmed from 
a value of zero to a value of one. The motivation to study 
WOM came from storage media like punch cards and optical 
disks. A renewed interest in WOM codes came along in the 
past years as a result of the tremendous research work on cod¬ 
ing for flash memories. Flash memories impose similar con¬ 
straints in which the level of each cell can only increase, and 
can be decreased only if its entire block is first erased. Thus, 
a WOM-code can be applied in flash memories to enable ad¬ 
ditional writes without first having to erase the block. WOM 
codes in flash memories were investigated both theoretically 
with respect to the number of block erasures, and practically 
by simulations; see e.g. Q, 0, m-& GD- 

The reduction in the number of block erasures via WOM 
codes is beneficial for extending device lifetime. However, 
this benefit comes with a significant price of non-negligible 
increase in the redundancy, thereby decreasing the over¬ 
provisioning in the memory. Note that when using WOM 
codes, it is possible to write more pages with less erasures 
since every block can be written more than once. There¬ 
fore, write amplification is not the right figure of merit for 
this method. Thus, we introduce a new measure, called era¬ 
sure factor, which is the ratio between the number of block 
erasures and number of logical block write requests. When 
WOM codes are not used, the erasure factor is equivalent to 
the write amplification. 

The main goal of this paper is to analyze the erasure factor 
when using WOM codes, while pages are written uniformly at 
random. In order to have a fair comparison with systems that 
do not use WOM codes, we fix the over-provisioning and then 
compare the erasure factor. We analyze two different imple¬ 
mentations of WOM codes. Conventional implementations of 
WOM codes used the codes in the page level such that each 
page is written multiple times, and hence incorporated capacity 
loss. We compare these with a new approach, recently proposed 
in Hg, that avoids the capacity loss by encoding information 
into more than a single page after the first write. 

The rest of the paper is organized as follows. In Section [11] 
we introduce the necessary background on flash memories and 
WOM codes, and formally define the problem we study in 


the paper. In Section [III] we review and state the results on 
the connection between over-provisioning and the erasure fac¬ 
tor without using WOM codes. In Section we study the 
conventional implementation of WOM codes and similarly an¬ 
alyze this connection. We then continue in Section |V] to study 
a more efficient implementation of WOM codes in which no 
rate loss is incurred and similarly study its erasure factor. 


may vary on each write. The capacity region of a f-write WOM 
is the set of all achievable rate tuples. For the binary case, the 
capacity region was found in 0.0. m It was also proved 
that the maximum achievable sum-rate for a WOM code with 
t writes is log 2 (f + !)■ Similar results were given for hxed- 
rate WOM codes 0. For example the maximum sum-rate of 
a two-write hxed-rate WOM code is 1.54. 


II. Definitions and Problem Statement 

A. Flash Memory Structure 

Flash memories consist of floating-gate cells that can typi¬ 
cally store a single bit, two bits, or three bits. The cells are or¬ 
ganized into blocks which usually contain 64-384 pages, where 
the size of a page ranges between 2KB and 16KB Q. Due 
to the inherent asymmetry between programming and erasing, 
flash memories perform page writes out-of-place. This write 
procedure introduces the following concepts: 

• Flash Translation Layer (FTL): The FTL is responsible 
for mapping logical locations to physical ones. 

• Over-provisioning (OP): The ratio between the amounts 
of additional storage and logical storage. This overhead 
is necessary to accommodate out-of-place writes. 

• Garbage Collection (GC): The process in charge of clean¬ 
ing blocks in order to free more space for writing. 

• Write Amplification (WA): The ratio between the number 
of physical page writes and the number of logical page 
write requests. 

The following summarizes the setup, notations, and assump¬ 
tions we use throughout the paper. These notations hold for a 
flash memory device, e.g. a solid state drive. 

1) Every block has Z pages, each of size sKB. There are T 
physical pages and Lf logical pages, where both T and U 
are a multiple of Z. 

2) The over-provisioning is p = (T —U)/U and a = 
U/T = l/(p -h 1) is the storage rate, which is the ratio 
between logical data and physical storage. 

3) WA = P/L, where L is the number of write requests 
of logical pages and P is the number of resulting physi¬ 
cal page writes. We also dehne L/Z to be the number of 
logical block writes. 

B. WOM Codes 


WOM codes were hrst introduced by Rivest and Shamir in 
1982 1141, and were found to be very relevant in the context 
of rewriting algorithms for flash memories. In this setup, the 
memory consists of n cells and the goal is to maximize the 
number of bits which can be written to the memory in t writes, 
while guaranteeing that each cell is changed only from 0 to 1. 
The most famous example of a WOM code is the one given by 
Rivest and Shamir for writing two bits twice using only three 
cells m- In their work, they also analyzed the bounds on the 
amount of information that can be stored in a WOM. Since 
then, more constructions were given in the 1980’s and 1990’s, 
e.g., 0 as well as capacity analysis, e.g., 0,0. Several more 
constructions of WOM codes were recently given; see e.g. 0, 

(H), in) 


Assume t messages are written to the memory, consisting of 
n cells. On the f-th write, 1 ^ i ^ f, the message size is M;. 
The rate on the ;-th write is dehned to be TZj = ^ 

the sum-rate is TZ^um = T^i- We consider two types of 
WOM codes GZl- In 2 l fixed-rate WOM code, the rate on all 
writes is the same, while in a variable-rate WOM code the rate 


C. Problem Setup 

The main goal of this work is to study the connection be¬ 
tween the over-provisioning p (or storage rate a) and the num¬ 
ber of block erasures. This connection depends upon the over¬ 
provisioning value, GC algorithm, and the probability distribu¬ 
tion of the page write request^ We assume in this work that 
requests are uniformly distributed over the 11 logical pages. 
We follow the observation from claiming that greedy GC 
is optimal for uniform distribution, where greedy GC always 
chooses the block with the minimum number of valid pages 
for cleaning. We also assume that greedy garbage collection is 
invoked whenever there are no more clean blocks. That is, we 
don’t require a minimum fraction of available blocks since the 
analysis is very similar to the one without this requirement 0. 

WOM codes allow to write the blocks multiple times before 
an erasure. Thus, WA is not the right hgure of merit since it 
is possible to write more pages and yet erase less. Hence, we 
introduce a new measure that better characterizes this behavior. 


Definition 1. The erasure factor EF in a Hash memory sys¬ 
tem is the ratio between the number of block erasures E and the 
number of logical block writes L/Z. That is. 


EF = 


E 

LfZ' 


Note that if no rewriting code is used then EF = WA. In the 
rest of the paper, we study the erasure factor of several systems 
with and without WOM codes, demonstrating how the specific 
usage of WOM codes directly affects this figure of merit. 


III. The Relation between Over-provisioning and 
Erasure Factor 


The relation between the write amplification and over¬ 
provisioning has received a significant attention in recent 
years due to its importance to the lifetime of flash memories, 
see e.g. 0, og, |T§. Of the numerous works in this area, 
we consider two recent studies which we believe give an ac¬ 
curate model of this analysis 0, m- The proof given here 
is based upon the analysis in these two studies and we give 
it in completeness since its understanding is crucial to the re¬ 
sults in the paper. For the purpose of our discussion, we call 
the system in these studies, that does not use WOM codes, 
the baseline system. 


Theorem 2. The number of block erasures E and the erasure 
factor EFi (a) of the baseline system are given by 


E = 


P 

I 


L 

Z{l-a')' 


£Fi(a) 


where a = F, , or of = —a-W{ — \e 

In(a') a 

the Lambert W function. 



oC 




( 1 ) 


and W(x) is 


Proof: For 0 ^ i ^ Z, let N{i) be a random variable 
corresponding to the number of blocks with i valid pages, so 

* and also on Z but we assume in the paper that Z is lai'ge enough to avoid 
this dependency. 








N(/) = T/Z. If we denote by Y the expected number of 
valid pages when a block is erased, then for 0 ^ ^ Y — 1, 

N{i) = 0, and N{Y) is relatively small enough. We assume 
that the system is in steady state and thus the expected value of 
N{i) doesn’t change over tim^ According to this assumption, 
we also get that for Y + 1 ^ t ^ Z, 

iN{i) = C, 

for some constant C, or N{i) = (Y + 1)N(Y + l)/f. There¬ 
fore, we gej^ 

T/Z = Y^Nii)= £ N(i)= £ (Y + l)N(Y + l)/i 

i=0 i=Y+l i=Y+l 

= (Y + 1)N(Y + 1) £ \ 

i=Y+l ' 

w (Y + l)N(Y + l)(ln(Z)-ln(Y)) 

= (Y + l)N(Y + l)ln(Z/Y). 


We also have that 

z z 

U=Y,iN{i)= Y. tN(f) = (Z-Y)(Y + 1)N(Y + 1) 

1=0 i=Y+l 

Together, we get that 

T/Z _ U 


or 


(Y + 1)N(Y + 1) = 
U Z-Y 


oc = — = 


ln(Z/Y) Z-Y' 
_ Y/Z - 1 _ a' - 1 


T Zln{ZlY) ln(Y/Z) ln{oc')' 
where ck' = YjZ, and is given by a' = —a ■ W ■ 

Now, we deduce that for every Z — Y logical page writes, 
Z physical pages are written. Hence, P = L ■ = pZa'’ 

and 

„ P L , E 1 

^ 7 / ry 7 j- 

Z Z{l—a') LjZ \—oc ■ 

IV. Analysis of the Naive-WOM System 


In this section, we take a first step in analyzing the erasure 
factor when using WOM codes. However, as we shall later see, 
this analysis depends on the specific implementation of WOM 
codes in the memory. In order to have a fair comparison with 
the baseline system, we carry out this comparison while fixing 
a, the ratio between logical and physical storage. Furthermore, 
in order to minimize the modifications in the architecture, we 
assume that the block size is fixed, however we will allow 
to change the size of the physical pages and accordingly the 
number of physical pages in a block. 

Let us start by describing the conventional setup to imple¬ 
ment WOM codes in flash. This setup was tested experimen¬ 
tally in several studies, see e.g. 0>ini along with analytical 
derivations in GD- Assume a two-write fixed-rate WOM code 
is used with individual rate R on each write, so K ^ 0.77 ©■ 
Here, WOM codes allow to write each block twice before an 
erasure. First, all pages are written sequentially in the block 
and after the block is chosen by GC, it is possible to write to 
the invalid pages. Thus, every block can be either on a first or 
second write. The modifications in the system setup compared 
to the baseline system are summarized as follows: 


^These properties are taken from j^, where this process is modeled as 
a Markov chain and the number of blocks with a given number of valid pages 
is fixed for analysis purposes. 

^While there are better approximations to the differences between two Har¬ 
monic series, we choose this one since it provides better expressions which 
can be analyzed without dependency on the number of pages in a block. 


1) A two-write WOM code with fixed-rate R on each write 
is used to write all pages. Thus, the size of every physical 
page is ^sKB so it can accommodate a write of a logical 
page which is encoded by the WOM code’s encoder. 

2) As a result of increasing the physical page size, the num¬ 
ber of pages in a block reduces to Z' = RZ, so the block 
size remains the same. Accordingly, the total number of 
physical pages is also reduced to T' = RT. Hence, the 
ratio 13 between the number of logical pages and physical 

^ ~ T ~ RT ~ R' 
and thus the storage rate is cc = I3R. 

3) We use the same greedy GC as in the baseline system, and 
hence the block with the minimum number of valid pages 
is chosen by the GC. If the block is on first write, then 
it is moved to second write, and since it is not erased, its 
valid pages remain in the block. If the block is on second 
write, then its valid pages are rewritten on an available 
block and the block is erased. 


We call this method of implementing WOM codes the naive- 
WOM system. Since the value of 13 is at most 1, we can com¬ 
pare the baseline system and the naive-WOM system only for 
a ^ R = 0.77. The next theorem states the result of the era¬ 
sure factor under this setup. The proof is omitted due to the 
lack of space and since it is a direct application of Theorem]^ 


Theorem 3. For any a R, under uniform writing with greedy 

GC, the erasure factor EF 2 {tx) of the naive-WOM system is 

given by rr t \ ^ 

EFiioc) = 


where 13'= —13 ■ W 


2(1-13') 


, and ^ = %■ 


Finally, we can compare these two systems and find the val¬ 
ues of a in which the naive-WOM system is superior to the 
baseline system with respect to the erasure factor. 


Corollary 4. The naive-WOM system for t = 2 with rate R has 
better erasure factor than the baseline system if 

+ ( 2 ) 

In particular, for R = 0.77, it has better erasure factor for a ^ 
0.6442. 


The extension to multiple writes is immediate. Assume the 
individual rate on each write is Rt where the optimal values of 
Rt are given in ||^. Then, as before, we have that the erasure 
factor EFt(a) is given by 


EFt{a) = 


(l + f 


R, 

_L /7 rt 


(3) 


In Fig. we plot the curves of EFt{a) a for 2 ^ ^ 7, and 

the respective optimal Rt values. 


V. Analysis of the Capacity-Preserving-WOM 
System 


The main disadvantage of the naive-WOM system is its high 
rate penalty and thus an increase in the over-provisioning. In 
fact, this is a major caveat which prevented a wide adoption of 
WOM codes in flash memory devices. Furthermore, it also re¬ 
quires to either change the page or block size, which introduces 
another level of complication in the architecture design. 

These two disadvantages were recently resolved in Glby 
proposing an implementation of WOM codes which requires 













Fig. 1. A comparison between the erasure factors of the baseline and naive- 
WOM systems with multiple writes. 


neither storage rate loss nor changing the page size. The full 
details of this implementation include considerations of per¬ 
formance, parallelism and the complexities of the encoder and 
decoder 118|. For the sake of analyzing the erasure factor, we 
take a less restrictive approach which does not affect the analy¬ 
sis results. We call this scheme the Capacity-Preserving WOM 
system or in short CP-WOM system. We only give the main 
ideas of this implementation as the full details appear in m- 
Choice of a WOM code: The capacity region of a two-write 
WOM is given by the formula 0’ 0 

C2 = {{RvRi) I e [0,0.5],Ki ^ h{p),R2 < 1 - p}. 


where h is the binary entropy function. In particular, the rate 
tuple (1,0.5) belongs to this region, and thus we assume that 
a two-write WOM code with these rates exists. In practice, we 
note that it is hard to hnd such codes that are successful in 
the worst case. Thus, the work in p 8 | used polar WOM codes 
which are capacity achieving and their success is guaranteed 
with high probabilit}]^ It is also possible to use the recent de¬ 
sign of capacity achieving WOM codes by LDGM codes |j^. 
Note that since we use WOM codes with rate (1,0.5) there is 
no capacity loss on the first write and thus the storage rate re¬ 
mains the same. 

FTL Consideration: From the FTL point of view, every block 
can be in one of two states. When it is clean, pages are writ¬ 
ten to it sequentially such that there is no capacity loss (the 
rate of the WOM code on this hrst write is 1). After a block is 
chosen by the GC, it is not physically erased. Instead, its valid 
pages reside in the block and the invalid pages can be used 
to accommodate a second write. Now, every logical page will 
be encoded and written into two physical pages in the block 
(since the rate of the second write is 0.5). When this block is 
chosen again by the GC, its valid pages are copied and rewrit¬ 
ten in order to allow a physical erasure of the block. 

Greedy GC Policy: The blocks in this implementation can be in 
two different states: first or second write. The greedy GC pol¬ 
icy is characterized by a parameter 0 ^ yi ^ 1. Let Bi, B 2 be 
the blocks with the minimum number of valid logical pages on 
a first, second write, respectively. If the number of valid pages 
in is at most Yi = yj ■ Z then this block is moved from 
first to second write, and otherwise the block B 2 is physically 
erased and its valid pages are copied and written to an avail¬ 
able block. The value of yi in the greedy GC which optimizes 
the number of erasures and the corresponding erasure factor is 
found in the next theorem. 


'^Note that it is possible to retry the encoding of polar WOM codes with a 
different dither, thereby the failure probability is negligible for any practical 
purpose. 


Theorem 5. For any storage ratio a and greedy GC with param¬ 
eter yi, the erasure factor of the CP-WOM system is given by 

RFiiwn) = 777 ::;— 7 ^- 7 ;—(4) 


where y 2 satisfies the relation 


3/2-yi/2-y2' 


y 2 = -aW + _ 


The optimal erasure factor is given by 

EF|(a;) = min {EF 2 (a,yi)} 


o^n^i 


(5) 

(6) 


Proof: Let Yi = yi ■ Z and let us denote by Y 2 the ex¬ 
pected number of valid pages when a block on a second write 
is physically erased and let y 2 = Y 2 /Z. We will determine 
the relation between the values of Yj and Y 2 . For 0 ^ ^ Z, 

we denote by Ni{i),N 2 {i) the number of blocks with i valid 
pages on a first, second write, respectively. Notice first that for 

1 ^ Yy, Ni{i) = 0 and for i ^ Y 2 , N 2 {i) = 0. Furthermore, 
when a block is moved from first to second write, it already 
contains Yy valid pages. Since every logical page is written into 

2 available pages, the total number of logical pages this block 
can accommodate is at most Yy -|- (Z — Yy)/2 = (Z -|- Yy)/2 
and thus N 2 {i) = 0 for t > (Z -|- Yi) jl. 

We follow the same steps of the proof of Theorem]^ to have 
the following equations: 


(Yy + l)Ny(Yy + l) = ---=ZNy(Z) 


= (Y2 + 1)N2(Y2 + 1) = --- = 




2 2 ' 

According to these definitions, a block can accommodate Z 
page writes on the first write and (Z — Yy )/2 more page writes 
on the second write. Furthermore, on every block erasure, Y 2 
pages are rewritten, so the number of erasures is given by 

L + EY 2 


or 


E = 


E = 
L 


Z + (Z-Yy)/2 

L 


3Z/2 - Y 2 - Yy/2 Z 3/2 - yy/2 - y 2 ' 
Hence, the erasure factor, as a function of both yy and y 2 is 
l/( 3 / 2 -yy/ 2 -y 2 ). 

Following the rest of the steps from Theorem^ we get 

Z+Yi 

r/Z=£(Ni(i) + N2(i))= I: Ni(0+ t ^2{i) 

1=0 i=Yi+l i=Y2 + 1 

Z+Yi 

- £ (yi + l)Ni(Yi + l) + I’ (^1 + l)Ni(Yi + 1) 


/=yi+i 

= (Yi + l)Ni(Yi + l) 


i=Y2 + l 
Z 


z+n N 

I 7+ I 7 

i=yi+i ^ i=y2+i ' , 


(Yi + l)Ni(Yi + l) In 


-bln 


Z + Yy 
2 Y 2 


-(Y, + i)N.(y, + i)i„(7tn). 

As before, we also have 

z z 

U='£ tNy(f) + I; iN 2 {i) 


i=0 


i=0 


Z+Yj 


= E iNi{i)+ E 

i=Yi+l i=Y2+l 

= (3Z/2 - Yy/2 - Y 2 )(Yy + l)Ny(Yy + 1). 
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VI. Conclusion 



Thus we get 

(yi + i)Ni(Yi + i) = 


u 


T/Z 


a = 


3ZI2-Yij2-Y2 

3/2-71/2-72 


In 


( i+yi A' 
V 27172 J 


In 


l+Tl / 

27172 J 


that is 


72 = -aW 2 / 7 ) + \ ^ _ (7) 


Hence, the erasure factor, as a function of a and 71 is 

EF2(a,7i)= ^ 


3/2-71/2-72' 


where 72 is given by < 0 - Lastly, since we can choose the 
threshold 71 , the value EF|(a:) is achieved by minimizing the 
value of EF 2 {a,Yi} under the condition in 0 . ■ 

In Fig. 1^ we plot the curves of the erasure factors of the 
baseline, naive-WOM, and CP-WOM systems for two writes. 
We see that the CP-WOM system always has a better erasure 
factor than the baseline system. The naive-WOM system has 
better erasure factor than the CP-WOM system roughly for 
a ^ 0.54. This is not surprising since for small values of oc, 
no pages are copied by the GC, so the best EF of the CP-WOM 
system is 1/1.5 = 2/3 while the best EF of the naive-system 
is 1 /2. The extension to multiple writes follows similar steps. 


Theorem 6. For any storage ratio a and a CP-WOM system for 
t writes, the erasure factor is given by 


EF;{a) 


min {EF/(a,7i,72, ...,7i_i)} , 

0^7772.-/71-1^1 


(8) 


where 

EF/(a,7i,72, ...,7i_i) = 


and Yt satisfies 


a = 


2 _3_ 

^ 2^-1 


2_]_ 

^ 2^-1 






Yt 


(9) 


Yt 


I/=lIn 


f l+2i- 


'It± 


M I 2 UI 7 . 


( 10 ) 


The primary goal of this paper is to establish the founda¬ 
tions in analyzing the erasure factor (as an alternative measure 
to the unsuitable WA) when using WOM codes. This analysis 
is very important since it answers the fundamental questions 
regarding the potential benefit of using WOM codes in flash 
memories and similar memories. We hope that similar studies 
will be conducted in order to analyze the performance of other 
coding schemes with respect to the erasure factor. Some future 
research directions are summarized below. 

1) A tighter approximation of the erasure factor when blocks 
have a relatively small number of pages. 

2) Analysis of other systems implementing WOM codes and 
additional coding schemes. 

3) Analysis of non-binary WOM codes. 

4) Analysis of workloads other than the uniform writing; see 
for example 0 , |T 6 |. 
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